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M Abstract 

Factor  analyses  were  performed  on  data  from  51  subjects  tested  on  the  CAMI  Multip 
Task  Performance  Battery  (MTPB).  Five  different  complex  performance  task  combine 
t ions  were  used  as  well  as  the  six  individual  MTPB  tasks  performed  by  themselves. 
The  primary  treatment  of  the  data  involved  factor  analyses  of  the  tasks  of  the  ti 
different  complex  tasks  along  with  appropriate  measures  of  the  tasks  performed 
singly.  The  results  were  interpreted  to  support  the  hypothesized  existence  of  a 
time-sharing  ability.  Orthogonal  factors  were  found  on  which  the  monitoring  task 
in  general , loaded  during  simple  performance;  the  monitoring  tasks  loaded  on 
separate  orthogonal  factors  when  they  wer<  performed  as  a part  of  a complex  task. 
Potential  relevance  of  these  findings  to  aviation  selection  and  performance 
research  programs  is  noted.. 
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TIME-SHARING  ABILITY  IN  COMPLEX  PERFORMANCE:  AN  EXPANDED  REPLICATION 


I.  Introduction. 


In  an  earlier  study,  Jennings  and  Chiles  (1)  defined  the  concept 
time-sharing  ability  as  being  "a  reliable  source  of  variance  that  contributes 
to  performance  of  complex  tasks  but  is  independent  of  simple-task  performance 
of  the  constituent  tasks."  The  results  of  factor  analyses  applied  to  data 
collected  on  tasks  performed  both  singly  and  as  part  of  a task  complex  were 
found  to  fit  that  definition  in  the  case  of  three  monitoring  tasks.  One  of 
the  monitoring  tasks  involved  response  to  the  onset  of  any  one  of  five  red 
lights;  there  was  one  light  at  each  corner  of  the  subject's  panel  and  one 
light  in  the  center.  A second  monitoring  task  involved  response  to  the 
offset  of  any  one  of  five  green  lights  that  were  physically  paired  with  each 
of  the  red  lights  but  programed  independently.  The  third  monitoring  task 
involved  the  detection  of  a shift  in  the  average  position  of  a "randomly" 
fluctuating  meter  from  a normal  value  of  zero  to  a value  of  plus  or  minus  25; 
the  maximum  pointer  excursion  for  a meter  without  a signal  present  was  +_  25; 
detection  of  a signal  was  indicated  by  the  subject's  throwing  a three-position, 
spring-loaded-to-center  lever  switch  in  the  direction  in  which  the  subject 
thought  the  average  position  had  shifted;  immediate  feedback  was  given  by  the 
stopping  of  the  pointer  on  its  "true"  average  value.  Six  of  the  tasks  were 
used  to  construct  two  complex  tasks.  The  light-monitoring  tasks  were 
performed  singly  as  were  a mental  arithmetic  task  and  an  elementary,  group 
problem-solving  task;  the  mental  arithmetic  and  problem-solving  tasks  were 
also  performed  concurrently  with  the  lights  task  to  form  the  first  complex 
task.  A second  complex  task  was  made  up  of  the  meter-monitoring  task,  a 
pattern  discrimination,  and  a two-dimensional  compensatory  tracking  task;  each 
of  these  tasks  was  performed  both  singly  and  in  combination  as  a complex  task. 
The  findings  that  are  of  interest  to  the  present  discussion  were  (i)  the  three 
monitoring  tasks,  when  performed  under  complex  conditions,  had  large  loadings 
on  a single  factor;  (ii)  measures  from  the  monitori  g tasks  when  performed 
under  simple  task  conditions  showed  small  loadings  on  that  factor;  (iii)  the 
two  light-monitoring  tasks  had  large  loadings  on  another  orthogonal  factor 
under  simple  performance  conditions;  and  (iv)  the  meter-monitoring  task  had  a 
large  loading  on  still  another  orthogonal  factor  under  the  simple  condition. 

It  was  concluded  that  the  results  support  the  hypothesis  that  there  is  in 
fact  a complex-monitoring  ability  that  could  reasonably  be  called  a 
time-sharing  ability.  However,  the  number  of  subjects  per  measure,  39 
subjects  and  22  measures,  was  substantially  smaller  than  is  generally 
regarded  as  adequate  for  purposes  of  factor  analysis.  For  this  and  other 
reasons,  Jennings  and  Chiles  stated  that  ".  . . this  type  of  study  requires 
replication  before  final  acceptance  of  the  validity  of  the  concept  of 
time-sharing  is  warranted."  The  present  study  was  undertaken  to  provide  such 
a replication  and  to  provide  a wider  range  of  complex  tasks  (i.e,,  a greater 
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nuitlbot  ot  task  combinat  ions!  and  a somewhat  greatei  number  .'I  subjects.  A 
nu'ii'  v omp  lot  i'  i .11  ion. lit-  lor  I ho  stuilv  is  presented  in  that  earliet  roport 
.nnl,  theretore,  will  not  ho  ropoat  oil  lioro. 

II.  Mot  ho.  I . 

A.  Suh  jec  t s . Vho  il.it  a from  a solootoil  samplo  ol  ‘<1  malo  volant  oors  in 
I lio  i r twont  ios,  who  woro  pa  i il  for  thoir  sorvioos,  woro  used  in  the  analvsos 
ot  tin-  o\pot  imont.il  results;  .’I  suh  joe  ts  woro  tested  hut  not  included  in  the 
analvsos  because  ol  missing  data  and/or  failure  lo  follow  instructions. 

I>.  Apparat  us . file  AMI  Mult  iplo  Task  Performance  battery  (MTl’hl  was 
used  in  this  research.  The  MT1MI  consists  of  six  tasks  that  can  ho  programed 
i iiilepondont  1 v across  subjects;  up  lo  live  subjects  can  ho  tested  at  a time. 

Vho  tasks  can  ho  presented  in  anv  combination  ot  from  one  to  six  tasks 
simultaneously.  'lho  MTl’Il  system  is  comput  o r i cod  so  that  all  signals, 
problems,  etc.,  are  presented  and  scored  automat  ical Iv  under  computet  program 
control.  lho  raw  data  are  stored  on  magnet  ic  tape  for  later,  ol  I - 1 ine 
analyses.  Uriel  descript  ions  of  the  nature  and  performance  demands  ot  the 
tasks  toll  <w . 

1.  Red  and  green  1 ight s monitoring  ( Red  Lights  and  Green  Lights ) . 

\l  each  i'iirnt'1  and  in  the  center  o!  t lie  subject  s panel  are  located  pairs  ol 
integral  lights/switches.  Vho  upper  light  'switch  ot  each  pair  is  red  and  the 
lowei  one  is  green.  The  normal  state  is  loi  the  green  lights  to  he  on  and  the 
red  lights  to  he  oil.  A signal  consists  ol  a change  ot  slate  ol  a light  anil 
response  is  made  by  pushing  the  light  'switch;  this  returns  the  light  tc  its 
normal  state  and  a computet  record  is  generated  that  reflects  the  intormat  ion 
necessary  to  ideal itv  the  light  and  subject  involved,  the  t i me  of  onset  for 
oil  set  1,  and  the  t ime  at  which  the  response  is  made  (or,  it  no  response  is 
made,  the  t ime  ol  automat  ic  return  ol  tin'  light  to  its  normal  state!; 
response  t ime  is  recorded  in  mi  I 1 iseeonds  separately  lor  the  rod  and  the 
green  lights.  On  the  average,  a signal  feithei  red  oi  green!  is  introduced 
once  each  minute;  signals  that  are  not  responded  to  are  removed  attei  l1' 
seconds . 

, Meter  monitoring  (Meters!.  The  displays  toi  this  task  consist 
ot  tom  edge  reading  meters  having  lull  scale  values  ot  * '0  and  '0.  A 
signal  on  this  task  consists  ot  the  del  lection  ol  one  ol  the  meters  by  a 
controllable  amount  either  to  the  right  oi  to  the  lett  ot  center,  the  zero 
po i ut . Response  is  made  hv  depression  ot  one  ot  the  two  hut t oils  below  each 
meter  that  is  on  the  side  toward  which  I lie  metei  had  deflected.  It  a correct 
response  is  made,  the  signal  is  removed  and  the  pointer  returns  to  the  zero 
(average!  position  when  the  button  is  released.  the  apparent  ditticulty  ot 
the  task  can  he  vat ied  t rom  very  easy  (i.e.  , a signal  can  he  detected  at  a 
glance!  to  very  difticult  (i.e  , rather  caretul  observation  ot  the  meter  is 
required  tor  1 oi  more  seconds  by  the  introduction  ot  a "random"  background 
disturbance.  When  the  background  disturbance  (noise!  j s introduced,  the 
po i nt  e i wanders  about  unpredictable  with  an  average  posit  ion  ot  zero  it  no 


signal  is  present.  With  the  addition  of  a signal,  the  pointer  behavior 
continues  as  before  but  with  an  average  position  that  has  shifted  either  to 
the  right  or  to  the  left  of  center.  When  a button  for  a given  meter  is 
depressed,  the  background  noise  is  removed  and  the  pointer  stops  on  its  "true" 
average  value,  thus  giving  immediate  feedback  as  to  the  accuracy  of  the 
response.  When  the  button  is  released,  the  background  noise  is  again  added  to 
the  pointer  movement.  In  this  study,  the  amplitude  of  a signal  was  set  equal 
to  the  approximate  maximum  excursion  of  the  pointer  when  driven  by  noise  alone. 
Thus,  fairly  frequent  readings  beyond  the  normal  maximum  in  either  direction 
were  clear  evidence  of  the  presence  of  a signal.  Signals,  introduced  at  an 
average  rate  of  one  each  minute,  were  distributed  unpredictably  across 
displays  and  across  time.  A signal,  when  presented,  remained  until  responded 
to  or  until  replaced  by  a new  signal.  The  response  time  for  a given  signal 
was  computed  in  milliseconds  on  the  basis  of  the  time  the  signal  was 
introduced;  however,  if  the  subject  had  not  responded  to  the  preceding  signal, 
the  time  at  which  that  signal  was  introduced  was  used  in  computing  the  response 
time  to  the  later  signal;  this  procedure  was  extended  back  in  time  to  include 
all  contiguous,  not-responded-to  signals  in  calculating  the  response  time  on 
this  task.  Thus,  the  number  of  signals  presented  in  a given  session  was,  for 
computational  purposes,  determined  by  the  number  of  signals  to  which  the 
subject  had  responded  correctly. 

3.  Mental  arithmetic  (MATH).  The  display  for  this  task  is  a 
256-character  (32  characters/row  by  S rows)  Burroughs  self-scan  display. 
Characters  are  formed  at  a given  character  position  by  the  illumination  of 
configurations  of  dots  in  each  5-dot-wide  (46  mm)  bv  7-dot-high  (.67  mm) 
matrix.  Actually,  only  the  bottom  row  of  characters  is  used  to  present  the 
arithmetic  problems.  A typical  problem  might  be:  57  + 29  - 45  = ? (answer: 
41).  The  subject  enters  the  answer  by  using  a reverse-order  serial  entry 
keyboard;  it  requires  that  the  least  significant  digit  be  entered  first. 

Thus , for  the  above  problem,  the  subject  first  enters  the  number  1,  which 
appears  in  the  extreme  right-hand  cell  of  the  bottom  row;  next,  he  enters  the 
number  4 and  it  appears  in  the  cell  that  is  second  from  the  right  in  that  row. 
Two  correction  buttons  are  provided,  one  for  "erasure"  of  the  last  digit 
entered  and  one  for  erasing  all  digits  entered.  When  the  subject  has  entered 
what  he  considers  to  be  the  correct  answer,  he  depresses  a "complete" 
button.  At  that  time,  the  accuracy  of  the  answer  is  determined  and,  if  it  is 
correct,  an  "R"  appears  in  the  cell  second  from  the  right  of  the  top  row  of 
the  display.  If  the  answer  is  wrong,  a "W"  appears  at  that  location; 
simultaneously,  the  problem  and  answer  are  removed  from  the  display.  The 
problem  elements  in  this  study  could  take  any  value  from  11  through  99;  they 
were  selected  so  that  neither  of  the  "plus"  elements  would  be  the  same  as  the 
"minus"  element  and  the  problems  were  constructed  so  that  approximately  half 
the  answers  would  be  greater  than  100  and  half  less  than  100.  Time  from  the 
introduction  of  the  problem  until  depression  of  the  "complete"  button  is 
measured  in  milliseconds.  Problems  are  presented  at  20-second  intervals. 
Accuracy  (correct  answers/total  problems  presented)  was  used  as  the  single 
measure  of  MATH  per formance . 
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•'* . Pattern  discrimination  (HO.  The  upper- left  six-character  bv 
six-row  portion  of  the  burroughs  self-scan  display  is  used  to  present 
problems  on  this  task.  For  a given  character  position  in  this  matrix,  all 
the  dots  in  a r>-dot  bv  7-dot  matrix  can  be  illuminated  to  form  a lighted 
rectangle.  These  lighted  rectangles  are  then  used  to  form  vertically 
oriented  bargraphs  w i t h each  column  height  from  one  through  six  appeal ing 
just  once.  The  problems  on  this  task  are  analogous  to  a question  on  a 
multiple-choice  examination.  The  first  pattern  presented  for  a given 
problem  is  the  standard  or  "question"  pattern.  This  pattern  is  followed  bv 
t wo  comparison  patterns  that  yield  three  possible  answers:  li)  one  ot  the 

comparison  patterns  might  be  the  same  as  the  standard;  ( i i 7 iwo  (both) 

comparison  patterns  might  be  the  same  as  t lie  standard;  or  (iii)  neithei 

comparison  pattern  might  be  the  same  as  the  standard.  The  subject  indicates 
his  answer  bv  depressing  one  of  three  switches  labeled  "1,"  "7,"  and  "N."  (hi 
entering  his  answer,  which  is  not  acknowledged  bv  the  system  unless  made  after 
the  onset  of  the  second  comparison  pattern,  the  correct  answer  appears  in  the 
extreme  upper- le ft-character  position  of  the  display.  The  timing  sequence 
for  this  task  is  as  follows:  the  standard  pattern  appears  for  h seconds  and 
each  comparison  pattern  appears  for  7 seconds  with  1 second  between  patterns; 
there  is  a IS-second  "off"  period  after  the  offset  ot  t lie  second  comparison 

pattern.  Thus,  problems  are  presented  every  HI  seconds  on  this  task.  both  ir 

speed  of  response  (measured  in  milliseconds  from  the  onset  of  the  second 
comparison  pattern)  and  accuracy  can  be  recorded,  but  in  this  study,  accuracy 
was  used  as  the  single  measure  of  performance. 

I.  1’ rob  lent  solving  ( I’S ) . Kaeh  subject’s  test  panel  is  equipped 
with  five  pushbutton  switches,  a wli  i t e "task  active"  light  , and  three 
"feedback"  lights.  The  task  requires  the  subject  t o discover  the  correct 
sequence  in  which  to  press  the  buttons  in  order  to  turn  on  a blue  feedback 
light  that  signifies  the  problem  has  been  solved.  Anytime  a button  is 
pushed,  an  amber  light  is  illuminated  to  show  that  t lie  response  has  been 
acknowledged  by  the  system.  A red  light  provides  error  feedback.  the 
subjects  are  instructed  to  follow  a standard  search  procedure,  always 
beginning  with  the  leftmost  button  and  proceeding  from  left  1 1'  right.  fhe 
initial  illumination  of  the  wli  i t e and  the  red  lights  indicates  to  the  subject 
that  an  unsolved  problem  is  present.  Subsequently,  the  red  light  provides 
error  information  as  follows:  Anytime  any  one  ot  t lit'  buttons  is  depressed, 
the  red  light  goes  out.  If  t ho  button  pushed  is  the  correct  first  response 
for  a given  problem,  the  red  light  will  remain  out  when  the  button  is 
released.  Thus,  the  initial  step  in  solving  a problem  is  t o push  the  buttons 
one  at  a time  until  the  button  is  found  that,  when  released,  leaves  the  red 
light  off.  The  search  then  continues  for  t lie  next  button;  if  it  is  correct , 
the  red  light  remains  out  when  that  button  is  released;  if  it  is  wrong,  tin- 
red  light  comes  back  on  and  the  button  previously  determined  to  be  the  first 
button  must  be  pushed  again  to  continue  the  search  for  the  second  button  in 
the  sequence.  The  search  proceeds  in  an  analogous  manner  until  each  of  tin-  »• 
five  buttons  has  been  pushed  just  once  in  the  correct  sequence  for  a given 
problem.  At  that  point,  the  blue  light  comes  on,  signifying  that  the  problem 
has  been  solved.  After  a lapse  of  70  seconds,  tin-  blue  light  goes  out  and  the 


red  and  white  lights  come  back  on;  however,  this  time  the  onset  of  those  lights 
indicates  that  the  same  problem  is  being  presented  a second  time.  Thus,  the 
subject  must  remember  the  correct  sequence  and  cannot  (efficiently)  solve  all 
problems  in  a t rial-and-error  manner  without  paying  attention  to  which  buttons 
are  correct  and  which  are  incorrect  for  a given  phase  of  the  solution.  After 
entering  the  solution  a second  time  and  after  another  lapse  of  20  seconds,  the 
blue  light  goes  out  and  the  red  and  white  lights  come  on,  but  this  time  these 
events  signify  that  a new  problem  is  present.  Thus,  efficient  performance 
requires  that  the  subject  also  remember  whether  a problem  is  being  presented 
for  the  first  time  or  is  a repetition  of  the  previous  problem.  Several 
measures  can  be  derived  from  this  task:  (i)  the  speed  of  solution  of  the  first 
presentation  of  a problem;  (ii)  the  speed  of  entering  the  second  solution 
(confirmation);  (iii)  the  occurrence  of  redundant  responses  (responses  made 
when  information  already  acquired  should  make  the  subject  aware  that  the 
response  being  made  is  not  correct);  and  (iv)  errors  made  on  the  second  entry 
of  the  solution.  Solution  accuracy  (PS-Sol)  and  confirmation  time/problem 
(PS-Conf)  were  used  in  the  present  study.  Although  the  time  between  the 
presentations  of  problems  is  fixed  at  20  seconds,  the  rate  at  which  the 
subject  attempts  to  solve  the  problem  is  subject  paced;  the  problem  remains 
until  solved. 

6.  Two-dimensional  compensatory  tracking  (TRK).  The  display  for 
the  tracking  task  is  a 7.5-cm  oscilloscope  cathode-ray  tube  (CRT)  mounted  in 
the  upper-center  part  of  the  subject's  panel.  The  target  on  the  CRT  is  a dot 
of  light  about  1 mm  in  diameter,  and  the  center  of  the  CRT  is  defined  by  hori- 
zontal and  vertical  crosshairs  scribed  on  a plastic  cover  in  front  of  the  CRT. 
The  subject's  task  is  to  use  a control  stick  to  attempt  to  counteract  a 
"randomly"  varying  disturbance  imparted  to  the  dot  by  the  computer  and  keep 
the  dot  as  near  to  the  intersection  of  the  crosshairs  as  possible.  The 
maximum  amplitude  of  the  disturbance  and  the  stick  gain  are  set  so  that 
appropriate  manipulation  of  the  stick  can  always  bring  the  dot  to  the  center  of 
the  screen.  Performance  of  the  tracking  task  is  scored  by  analog  circuitry 
that  integrates  absolute  error  and  a quantity  that  is  proportional  to  error 
squared  for  each  dimension.  The  integration  period  is  1 minute,  and  the 
computer  reads  out  and  records  the  four  error  measures  for  each  subject  at  the 
end  of  each  minute.  The  error-squared  measure  is  converted  to  RMS  (root  mean 
square)  error  and,  in  addition,  vector  RMS  and  vector  absolute  error  measures 
are  derived.  Previous  research  (2)  has  shown  that  these  measures  are  all 
highly  intercorrelated ; therefore,  vector  RMS  error  was  used  as  a single  index 
of  tracking  performance. 

7.  Task  combinations.  For  the  simple  task  conditions,  each  of  the 
six  tasks  was  performed  independently  for  15  minutes  on  each  of  2 successive 
days;  in  addition,  the  meters-  and  1 ights-monitoring  tasks  were  performed 
simultaneously  for  two  noncontiguous  15-minute  periods  on  each  of  those  2 days. 
Five  complex  task  conditions  were  used,  each  of  which  included  the  meters- 

and  the  1 ights-monitoring  tasks;  the  combinations  were  (i)  problem  solving 
and  tracking  (PS/TRK),  (ii)  problem  solving  and  arithmetic  (PS/MATH), 

(iii)  pattern  discrimination  and  tracking  (PD/TRK),  (iv)  pattern  discrimination 
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and  problem  solving  (PD/PS),  and  (v)  arithmetic  and  tracking  (MATH/TRK).  Each 
of  these  combinations  was  performed  for  ill  minutes  on  each  of  2 subsequent 
days.  On  the  mornings  of  the  2 test  days  following  training,  the  subjects 
performed  on  each  of  the  six  simple  tasks  in  a single  session  of  2 hours' 
duration.  After  lunch,  the  complex  tasks  were  performed  in  two  sessions; 
combinations  (i),  (ii),  and  (iii)  were  performed  as  a 90-minute  session  and 
combinations  (iv)  and  (v)  as  a 1-hour  session. 

On  the  first  day  of  testing,  subjects  were  given  approximately  1 hour  of 
training  and  orientation  with  each  task  introduced  bv  itself;  tin’  performance 
ot  the  subjects  was  closelv  observed  to  insure  that  the  subjects  appeared  to 
understand  what  was  required  on  each  task.  The  subjects  were  instructed  that 
they  were  to  try  to  do  their  best  on  each  task  at  all  times. 

III.  Results. 


Reliability  coefficients  were  calculated  for  each  measure  for  each 
performance  condition  using  the  Dav  1 vs.  the  Hay  2 data.  Since  the  factor 
analyses  were  carried  out  on  the  means  of  the  2 days  of  performance,  the 
Spearman-brown  prophecy  formula  was  used  to  compute  the  expected  reliability 
of  those  means.  The  resultant  coefficients  are  shown  in  Table  1.  The 
coefficients  for  the  green  lights  task  were  significant  for  all  conditions 
except  the  combination  involving  arithmetic  and  tracking.  Only  three  of  the 
coefficients  were  significant  for  the  rod  lights  task:  the  conditions  with 
problem  solving  and  tracking,  pattern  discrimination  and  tracking,  and 
pattern  discrimination  and  problem  solving.  Two  of  the  reliability 
coefficients  were  significant  for  the  meters  task;  these  were  the  simple 
condition  and  the  problem  solving  and  tracking  condition.  All  three 
coefficients  were  significant  for  arithmetic,  but  only  one  was  significant 
for  pattern  discrimination — the  combination  involving  patterns  and  problem 
solving.  All  four  coefficients  for  nonredundant  responses  on  problem  solving 
were  significant  and  large,  and  all  four  coefficients  for  second 
so lut ion-t ime-per-prob lem  were  significant  though  not  as  large.  All  four 
coefficients  for  the  tracking  task  were  significant  though  not  large.  The 
correlation  matrix  of  all  of  the  measures  used  in  the  analyses  are  shown  in 
the  appendix. 

Five  factor  analyses  were  carried  out,  one  for  each  of  the  complex  task 
comb inat ions , to  examine  the  findings  for  evidence  of  a time-sharing  factor. 
The  data  used  were  the  averages  across  the  two  trials  (one  per  day)  for  each 
measure  at  a given  level  of  complexity.  In  all  of  the  analyses,  the  principal 
axes  method  was  used  with  unity  in  the  major  diagonal.  Factors  were  extracted 
in  a stepwise  procedure  until  a factor  with  an  e igenva 1 uo  of  less  than  1 was 
obtained.  All  factors  with  eigenvalues  greater  than  l were  then  rotated  to 
simple  structure  by  the  normal  varimax  method.  In  the  case  of  the  simple 
task  conditions,  the  same  data  were  used  in  each  analysis  in  which  a given 
measure  appeared. 


A.  t oh I >•!!•  solving  .in.!  t rack i ng  (PS  l*RK ) . [Welve  measures  were  us.'.l 
in  this  analysis,  six  tot  each  level  of  complexity.  Tin*  measures  were: 
response  t inn's  to  (jreon  lights,  t o red  lights,  and  to  meters;  tor  problem 
solving,  percent  non  redundant  responses  (first  solution),  and 
sol ut  i on- 1 ime  per  - problem  (second  solution);  for  tracking,  vector  RMS  error. 

I AMI  l 9.  I actor  loadings  for  PS/TRk  Condition 


(S  simple  task  performance:  C complex  performance) 
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Vive  factors  were  extracted  with  the  eigenvalue  criterion  used.  After 
van  max  rotation  (Table  ) , the  first  factor  was  a mixed-loading  factor;  the 
second  t.ictor  was  rather  strongly  an  index  of  nonredundant  responding  on  the 
problem-solving  task;  the  third  factor  was  primarily  a monitoring  factor  for 
simple  task  conditions;  the  fourth  factor  was  rather  clearly  a tracking  error 
factor;  and  the  fifth  factor  was  primarily  a meter-monitoring  factor  with  a 
high  loading  for  complex  performance  and  an  intermediate  loading  for  simple 
per formance . As  regards  the  time-sharing  hypothesis,  the  tirst  tactor, 
although  somewhat  hot erogeneous , did  exhibit  properties  that  would  suggest 
such  an  ability;  it  had  large  loadings  for  response  time  to  green  lights  and 
red  lights  for  the  complex  condition,  and  large  loadings  for  t imo-por-problom 
on  problem  solving  for  both  simple  and  complex  performance  on  the  second 
so lut ion. 
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B . I’rohli'm  solving  anil  arithmetic  ( PS/MATH ) . Again,  12  measures  were 
used  in  the  analysis  with  percent  correct  on  arithmetic  being  used  rather  than 
vector  RMS  error  on  tracking.  Four  factors  were  extracted  (Table  3 ) ; the  first 
one  again  was  a mixed  factor  with  loadings  on  arithmetic  (simple  and  complex) 
and  problem-solving  t ime-per-problem  both  simple  and  complex  for  the  second 
solution.  The  second  factor  had  large  loadings  on  the  three  monitoring  tasks 
under  simple  conditions.  The  third  factor  was  essentially  an  index  of  percent 
nonredundant  responses  on  problem  solving,  and  the  fourth  factor  showed 
sizeabte  loadings  on  the  monitoring  tasks  under  the  complex  condition. 

T -MIL l 1.  I actor  Loadings  for  PS/MA1H  Condition 
(S  simple  task  performance;  C complex  performance) 
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C.  Pattern  discrimination  and  tracking 
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the  meters  task  under  both  simple  and  complex  conditions  and  the  fourth 
factor  showed  large  loadings  for  pattern  discrimination  under  both  conditions. 
Thus,  as  regards  the  hypothesized  time-sharing  ability,  the  only  suggestive 
finding  was  the  fact  that  green  lights  loaded  on  different  factors  for  the 
simple  and  the  complex  conditions. 

TABU  4.  f actor  Loadings  for  PD/TI1K  Condition 


(S  = simple  task  performance;  C = complex  performance) 
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D.  Pattern  discrimination  and  problem  solving  (PD/PS).  Twelve  measures 
were  used  in  this  analysis  and  four  factors  were  extracted  (Table  5).  The 
first  factor  showed  large  loadings  both  for  red  and  green  lights  under  the 
simple  condition  and  for  meters  under  both  the  simple  and  the  complex 
conditions.  The  second  factor  was  a fairly  clean  index  of  nonredundant 
responses  on  problem  solving.  The  third  factor  showed  large  loadings  for 
pattern  discrimination  under  the  simple  condition  and  for  problem-solving 
t i me-per-prob lem  for  the  second  solution  for  both  conditions;  it  showed  an 
intermediate  loading  for  pattern  discrimination  under  the  complex  condition. 
And  the  fourth  factor  was  primarily  an  index  of  red  and  green  lights 
monitoring  under  the  complex  condition. 
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I V . hi  seuss  i on  . 

A.  lie l i abi 1 i t v . Overall,  the  reliability  eoe t f i e i out s for  the  majority 
ot  the  task  measures  were  substantially  lowei  than  have  been  foutnl  in  I'revimm 
research  til  with  these  tasks.  One  likely  hypothesis  tor  aeeonnt  i hr  for  this 
finding  is  that  , compart'd  to  our  previous  work,  the  test  sessions  were  rein 
lively  long  (perhaps  inducing  some  variability  in  attentiveness!  and  the 
measurement  intervals  were  relatively  short  (reducing  the  nnmhei  of  available 
observat  ions ) . I'he  relatively  low  coefficients  for  the  metei  monitoting 
measures  under  all  hut  one  ot  the  complex  comfit  ions  were  quite  likely  the 
result  of  the  high  difficulty  level  of  the  task;  specifically,  the 
signal  to  noise  rat  io  was  low,  and  subjects  got  feedback  on  this  task  only 
when  t hey  responded.  The  low  coefficients  for  the  pattern  task  undet  t lie 
simple  and  the  PS/TRK  conditions  were  probably  a result  of  the  tact  that 
subjects  did  well  on  these  tasks  overall  (means  "M  . 8 and  17..’  percent  . 
respect ively),  and,  therefore,  theta'  was  litt  le  variance  on  the  measure. 

Aunt  hot  i iidt*x  ol  the  "reliability"  ot  the  measures  can  be  seen  in  the 
i nt error  re  I at  ion  matrix  (see  the  appendix).  In  fact  it  might  be  argued  that 
t tie  consistency  ot  the  measures  across  task  combinations  is  a hettei  estimate 


ot  tho  reliability  of  tin’  correlat  ions  used  in  t ho  factor  analyses  than  the 
Day  1/Dav  2 reliability  coefficients.  Considering  the  red  lights,  t he 
measure  for  each  task  combinat  ion  correlates  significantly  at  the  .OS  level  or 
better  with  the  various  green  lights  measures.  Similarly,  the  correlations 
among  the  different  task  combinat ions  lor  rod  lights  are  also  significant  at 
the  .OS  level  or  better.  Overall,  the  reliability  (or  at  least  the 
consistency)  of  the  measures  taken  as  a set  is  considered  I u be  adequate  for 
the  purposes  of  the  study. 

It.  (•'actor  Analytic  Findings.  The  results  of  the  factor  analyses  for  two 
ol  the  task  combinations  represent  a "clean"  replication  of  the  previous 
results  found  with  the  old,  electromechanical  version  of  the  MTPK  (1).  This 
was  the  combination  involving  problem  solving  and  arithmetic  and  the  combina- 
tion involving  arithmet  ic  and  tracking.  In  each  of  these  two  analyses,  two 
orthogonal  factors  were  found  for  the  three  monitoring  task  measures — one 
factor  for  monitoring  under  the  simple  eondit ion  and  another  factor  for  the 
complex  condition.  This  corresponds  direct  ly  to  the  previous  findings  (1) 
which  were  interpreted  to  suggest  that  there  is  a time-sharing  (or  complex 
monitoring)  ability. 

Two  other  task  combinat ions  yielded  results  that  were  compatible  with 
the  previous  findings  as  wo  1 1 as  with  the  I wo  above-mentioned  task  combina- 
tions. In  the  cast"  of  the  condition  involving  pattern  discrimination  and 
problem  solving,  tho  two  1 ight s-monitoring  measures  loaded  on  orthogonal 
lactors  for  the  simple  and  the  complex  eondit ions.  However,  both  the  simple 
and  complex  meters  measures  loaded  on  the  factor  that  represented  simple 
performance  for  the  lights  monitoring  tasks.  There  are  two  points  that  are  ol 
relevance  to  I he  behavior  of  the  meters  measure;  first  , the  predicted 
reliability  of  the  complex  meters  measure  was  .02  (based  on  the  Day  1/Day  2 
correlat  ion),  and,  second,  the  correlat  ion  between  the  simple  meters  measure 
and  this  part  icular  complex  meters  measure  was  .84.  Considering  these  two 
points,  it  is  not  surprising  that  both  meters  measures  loaded  on  the  "simple 
monitoring"  factor.  In  the  case  of  the  task  combination  involving  problem 
solving  and  tracking,  again  tin*  simple  and  complex  1 ight s-tnoni tori ng  measures 
loaded  on  different  factors  and  again  the  meters  measures  wore  somewhat 
aberrant . In  this  case,  however,  the  simple  meters  measure  loaded  on  the 
simple  1 i ght s-mon i t or i ng  factor,  but  the  complex  meters  measure  loaded  on  a 
separate,  orthogonal  factor  which  also  showed  an  intermediate  loading  for  the 
simple  meters  measure.  The  reliability  of  the  complex  meters  measure  lor  this 
eondit  ion,  though  not  except  tonal  (predicted  r = . )l14),  was  the  most  reliable 
ill  tin-  measures  of  meters  performance  under  any  of  the  complex  conditions. 

No  good  explanat  ion  of  this  finding  for  meters  in  this  I act  or  analysis 
suggest  s i t so  1 I . 

I'lie  I inal  task  combinat  ion,  pattern  discriminat  ion  and  tracking,  tits 
with  the  previous  lindings  and  the  other  analyses  of  the  present  study  only 
in  that  the  green  lights  measure  loads  on  different  factors  lor  the  simple 
and  the  complex  eondit  ions.  The  red  lights  measure  showed  essentially  cero 
reliability  under  the  complex  condition,  and,  since  the  correlation  between 

1 1 


tliis  measure  anil  tin-  simple  measure  was  .r>8,  it  would  be  exported  that  they 
would  load  on  the  same  factor;  as  it  turned  out  , this  was  I lie  factor  that  the 
simple  green  lights  measure  loaded  on. 

There  were  several  other  findings  from  the  factor  analyses  that  are  of 
interest  as  regards  the  tasks  of  the  MTI’B.  First,  in  each  of  the  analyses 
for  the  combinations  involving  problem  solving,  the  measure  of  percent 
nonredundant  responses  on  problem-solving  first  solutions  (for  both  simple 
and  complex  performance)  loaded  on  an  essentially  "pure"  factor.  The  second 
solution  measure  of  t ime-per-problem  was  somewhat  capricious;  it  loaded  on 
arithmetic  when  performed  with  arithmetic,  on  pattern  discrimination  in  that 
combination,  and  on  complex  monitoring  in  the  combination  involving  tracking. 
Vector  RMS  tracking  error  loaded  on  a "pure"  factor  when  tracking  was 
performed  with  arithmetic  and  with  problem  solving  and  on  the  same  factor  as 
complex  green  lights  in  the  combination  involving  pattern  discrimination. 
Pattern  discrimination  and  arithmetic  each  loaded  on  "pure"  factors  when 
performed  with  tracking,  but  when  they  were  each  performed  with  problem 
solving,  they  each  shared  a factor  with  a problem-solving  measure--t ime-per- 
problem  on  second  solutions.  It  should  be  noted  that  in  the  present  study 
problem  solving  was  an  individual  task  whereas  in  the  earlier  study  it  was  a 
group  task.  Therefore,  the  measures  in  the  present  study  should  have  been 
less  subject  to  contamination  from  errors  result ing  from  the  assignment  of 
subjects  to  test  groups. 

V.  Summary  and  Tone  1 us  ions . 

Fifty-one  subjects  were  tested  on  the  CAM I Multiple  Task  Performance 
Battery  under  conditions  that  permitted  an  examination  of  tin'  possible 
existence  of  a "time-sharing  ability"  across  a total  of  five  complex  task 
combinations.  Factor  analyses  of  two  of  the  task  combinat ions  gave  clear  cut 
support  for  the  earlier  results  reported  by  Jennings  and  Chiles  ll);  the 
study  found  "a  reliable  source  of  variance  that  contributes  to  performance  of 
complex  tasks  but  is  independent  of  simple-task  performance  ol  tin-  const  itueut 
tasks."  The  factor  analyses  of  two  task  combinations  also  supported  this 
finding  and  one  gave  support  to  the  earlier  finding.  It  is  concluded  that 
the  present  and  the  earlier  study  suggest  that  assessment  of  complex  perform- 
ance ability  should  be  a consideration  in  research  on  the  selection  ot 
personnel  for  aviation  jobs  requiring  complex  performance  as  well  as  in  the 
development  and  selection  of  research  tasks  to  be  used  in  evaluat  ing  changes 
in  operating  procedures  or  the  acceptability  of  taking  various  kinds  ot 
medications  while  performing  aviation-related  (as  well  as  other  kinds  ol) 
dut i es . 
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